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List  of  Abbreviations 


Common  abbreviations  which  are  used  throughout  the  report  are  the  following: 
w.r.t.  (with  respect  to) 
s.t.  (such  that) 
a.e,  (almost  everywhere) 
iff  (if  and  only  if) 

LTI  (linear  time  invariant) 

PSD  (power  spectral  density  or  power  spectra) 

WSS  (wide  sense  stationary) 
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List  of  Notation 


Below  we  list  some  of  the  notation  that  appear  frequently  throughout  this  report. 
It  is  by  no  means  extensive  since  more  notation  will  be  introduced  in  later 
chapters  as  deemed  necessary. 

Z-j.  denotes  the  set  of  nonnegative  integers, 

M  denotes  the  real  numbers. 

Re  denotes  the  extended  real  numbers,  i.e.  [— oo,cx)]. 

C  denotes  the  complex  numbers. 

Ce  denotes  the  complex  numbers  augmented  with  complex  infinity  (the  point 
on  the  north  pole  of  the  Riemann  sphere),  i.e.  Cg  =  C  U  {00} 

Li  (>1)  denotes  the  space  of  complex  valued  functions  defined  on  a  set  A  and  is 
integrable  w.r.t.  the  Lebesque  measure  defined  on  A. 

1/2  (j4)  denotes  the  space  of  complex  valued  functions  defined  on  a  set  A  and  is 
square  integrable  w.r.t.  the  Lebesque  measure  defined  on  A. 

V^^'^[A)  denotes  the  space  of  complex  m  x  n— matrix  valued  function  defined 
on  A  with  entries  belonging  to  L\{A), 

For  u}<0,  =  {/(•)  6  L5^^^(R)  :  €  L^^^{R)}  C  L^^^{R) 

(following  the  notation  in  [4],  p.  47). 

Ua  =  {s  eC  :  Jm{s)  >  a}. 

-lie  =  {s  €  C  :  Im{s)  <  a}. 

For  a>  0^  Sa  denotes  the  set  {s  6  C  :  |  Im{$)\  <  a}. 

If  c  G  C  and  A  C  C,  cA  =  {y  e  C  :  3x  e  A  s.t.  y  =  cx}. 

^mxn  denotes  the  space  of  functions  /(♦)  defined  on  Rg  which  can  be  written 
as  /(A)  =  /  k{t)e^^^dt  for  some  A:(-)  e  L5^^^(R).  Note  that  /(±oo)  = 

—00 

lim  /(A)=0. 

A— »±oo 


3 


^Krnxn  denotes  the  space  of  functions  /(•)  defined  on  Eg  which  can  be  written 
as  /(A)  =  c  +  p(A)  for  some  p(-)  €  a-nd  some  c  G 

denotes  the  space  of  functions  /(•)  defined  on  Mg  which  can  be  written 

as  /(A)  =  jk{t)e^^^dt  for  some  k{-)  6  L5^^”([0,oo)).  Note  that  /(oo)  = 

lim  /(A)  =  0. 

A— +0O 

^tixn  denotes  the  space  of  functions  /(•)  defined  on  Eg  which  can  be  written 
as  /(A)  =  c  +  5(A)  for  some  g{-)  6  and  ^ 

jt(‘)  denotes  the  Fourier  transform  of  a  function  k{‘)  G  L5”^”(E). 

lim  /(t)  =  0{g{t))  means  that  lim  =  M  for  some  M  G  C. 

lim  fit)  =  o{g{t))  means  that  lim  ^  =  0. 

t—^oo  t—*oo  ^ 
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Chapter  1 

Introduction 


1.1  Overview 

This  is  the  second  part  of  the  report  of  the  BOARD  funded  research  project 
“Filtering  and  control  of  systems  with  nonration al  signals  spectra” .  It  concen¬ 
trates  on  the  general  problem  of  approximating  a  given  irrational  scalar  power 
spectral  density  (PSD)  with  rational  functions.  Although  the  issues  arising  are 
generic  for  any  turbulence,  our  interest  in  this  study  arose  from  the  problem 
of  modeling  atmospheric  turbulence  in  adaptive  optics  (refer  to  the  mid-year 
project  report  [8]).  In  adaptive  optics,  the  PSD  is  typically  a  matrix  valued 
function.  Our  study  of  the  scalar  case  presented  in  this  report  is  a  first  step 
towards  a  theory  of  approximations  of  general  multidimensional  PSDs.  The 
main  approximation  tool  that  is  considered  in  this  report  is  the  Pade  approxi¬ 
mation  and  the  particular  PSDs  to  which  we  apply  the  theory  is  the  well-known 
Kolmogorov  and  von  Karman  spectra.  Results  in  this  report,  whether  they  are 
well  known  or  new,  were  independently  derived  by  the  authors  unless  stated 
otherwise. 


1.2  Organization  of  the  report 

In  chapter  2,  we  begin  the  discussion  by  recalling  some  facts  about  analytic 
extension  of  functions.  The  next  chapter  is  devoted  to  a  short  exposition  of  the 
important  Paley-Wiener  theorem  on  the  realizability  of  PSD.  Chapter  4  covers 
an  introduction  to  the  theory  of  Pade  approximation  and  a  direct  application 
of  it  for  constructing  rational  approximants  of  both  the  Kolmogorov  and  von 
Karman  spectra.  Based  on  the  approximations  of  Chapter  4,  in  Chapter  5 
approximate  state-space  generator  models  for  the  Kolmogorov  and  von  Karman 
spectra  are  derived.  Finally,  the  main  conclusions  that  can  be  drawn  from  this 
study  is  presented  in  Chapter  6. 
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Chapter  2 

Analytic  Extension  of 
Functions 


As  a  starting  point  for  onr  discussion,  we  consider  the  conditions  under  which  a 
function  defined  on  the  real  axis  will  have  an  extension  which  is  analytic  every¬ 
where  in  an  open  neighbourhood  of  that  axis.  In  particular,  we  are  interested 
in  the  case  where  the  defined  function  is  the  Fourier  transform  of  some  impulse 
response.  Analytic  extensions  are  important  because  in  systems  theory,  the 
transfer  function  of  a  system,  which  is  a  key  tool  in  the  analysis  of  LTI  systems, 
is  defined  on  a  part  of  the  complex  plane  rather  than  just  on  the  real  or  imagi¬ 
nary  axis.  The  relevance  of  the  discussion  to  follow  will  become  more  apparent 
in  later  sections  of  the  report. 

Remark  1  We  are  considering  the  extension  of  functions  defined  on  the  real 
axis  to  the  complex  plane  because  this  is  the  context  in  which  extension  prob¬ 
lems  originally  appeared.  The  results  that  follow  can  be  easily  adjusted  for  the 
extension  of  functions  defined  on  the  imaginary  axis. 

We  first  present  a  series  of  basic  results: 

Lemma  2  Let  be  a  complex  valued  function  defined  everywhere  on  the  real 
axis  and  suppose  that  it  has  an  extension  to  an  open  subset  of  the  complex  plane 
including  the  real  axis.  Then  for  the  extension  to  be  analytic  it  is  necessary  that 
be  infinitely  differentiable  w.r.L  uf. 

Proof,  The  necessity  is  immediate  due  to  the  hypothesis  that  extension  is 
analytic  on  the  real  axis  and  the  well  known  fact  that  a  function  of  a  complex 
variable  is  infinitely  differentiable  at  every  point  where  it  is  anal3d;ic.  ■ 

Theorem  3  Let  //”(•)  be  a  infinitely  differentiable  complex  valued  function  de¬ 
fined  on  the  real  axis.  Suppose  that  for  each  cjq  ^  Taylor  series  expansion 
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ofH{(jj)  about  (jjQ,  i,e. 


^  ^  ^n!  dA" 


n— 0 


(w-wo)” 


A=wo 


exists  and  has  radius  of  convergence  R{u)q)  >  0.  Then  H{')  has  an  analytic 
extension  to  an  open  subset  of  the  complex  plane  containing  the  real  axis. 


Proof.  Recall  that  a  real  valued  power  series  about  a  point  wq  converges  ab- 
solutely  within  its  radius  of  convergence.  This  implies  that  when  the  real  and 
imaginary  part  of  a  complex  valued  power  series  about  a  point  ojq  converges 
simultaneously  within  some  radius  of  convergence,  the  series  will  converge  ab¬ 
solutely  within  that  radius  of  convergence.  It  follows  that  for  a  fixed  u;o  G  R 
the  Taylor  series  expansion  about  (Vq  also  converges  for  all  s  G  C  satisfying 
|s  “  cjol  <  R{^o)-  The  series  in  turn  defines  an  analytic  function  on  the  open 
set  5  =  {s  G  C  :  Bljq  G  E  s.t.  \s  —  cjoI  <  containing  the  real  axis.  ■ 

Before  proceeding  further  we  wish  to  introduce  a  couple  of  definitions. 

Definition  4  A  matrix  valued  function  //(*)  =  ^  L5”^”(E)  is  said  to 

be  causally  generated  of  type  —a  (a  >  0)  if  it  posseses  the  following  properties: 

oo 

1.  H{‘)  has  an  inverse  Fourier  transform  h{t)  —  ^  f  H (u;)e^^^dcij  which 

— oo 

satisfies  f  h(t)e~^^^dt  =  R(uf)  Vo?  and  h(t)  =  OVt  <  0. 

—  oo 


£,  For'ii^jj  hij{t)  0{fij{t)e  “*)  and,  for  some  Mij  >  0,  fij{‘)  satisfies 
I  <  oo  V/3  >  0. 


Definition  5  A  matrix  valued  function  H{')  =  {Hij{-)}  G  L5^^”(E)  is  said  to 
be  of  type  —a  (a  >  0)  if: 

oo 

1.  The  inverse  Fourier  transform  h{t)  =  ^  f  H(Lo)e^^^duj  exists  and  satis- 

— oo 
oo 

fies  J  h{t)e^^'^^dt  =  H{u})  Vcj. 

—oo 

2.  For  Mi,  j,  hij{t)  and,  for  some  Mij  >  0,  fij{-) 

—Mij  oo 

satisfies  J  \fij(t)\  e^^dt  <  oo  and  f  \fij{t)  \  e~^^dt  <  oo  V/?  >  0. 

-oo  Mij 

Remark  6  The  condition  on  the  fij{-)’s  is  to  ensure  that  they  do  not  grow 
exponentially  as  t  — >  ±oo. 


Remark  7  It  is  clear  from  the  definitions  that  every  function  that  is  causally 
generated  of  type  —a  is  also  of  type  —a. 
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The  following  proposition  describes  a  method  to  construct  an  analytic  ex~ 
tension  of  H(’)  when  it  is  causally  generated  of  type  -a.  Before  stating  the 
proposition,  we  need  to  introduce  a  few  more  definitions. 

Definition  8  For  aeM,  no  =  {sGC:  /m(s)  >  a}. 

Definition  9  For  a  eR,  — Ha  =  {s  G  C  :  Im{s)  <  a}. 

Definition  10  For  a  >  0,  Sa  denotes  the  set  {s  e  C  :  \  /m(s)|  <  a}. 

Proposition  11  Suppose  that  H{')  6  is  causally  generated  of  type 

—a  then  H{u))  is  infinitely  differentiable  w.r.t  cj  and  H{‘)  has  an  analytic  ex¬ 
tension  to  n_a.  /n  particular j  on  5^  the  extension  is  given  by 


oo  - 


n=0 


n!  dw" 


{v/if 


Proof.  Let  h(-)  =  {hij{-)}  denote  the  inverse  Fourier  transform  of  if(-).  By 
the  integr ability  of  \Hij{-)\  and  the  properties  of  causally  generated  functions  of 
type  -a  we  have  that  for  any  e  >  0  and  some  Q  <  K^N  <  oo 


oo 


= 


e'’*dt 


I  j 

0  — oo 

N  oo 

J  J  Hij{u})e'‘^^du  e’'‘dt  +  J  J  /fy(w)e“"‘dw  e’’‘dt 

0  — OO  N  — OO 

AT  OO  OO 

J  j  \Hijiuj)\dije'>^dt  +  J{K  +  e)\fij{t)\e-^°‘+'^'>^dt 

0  -oc  N 

I J  Iff, ,  Ml  d^\(j +iK  +  £)  J  l/i,  (<)l 


\-oo  /  \  0 

<  OO  when  v  >  —a 


implying  that  J h{t)e~‘^^e~‘^^^dt  exists  for  v  >  —a.  Since  J  \hij{t)\e^^dt  <  oo 
0  0 
for  0  <  /?  <  a  it  follows  that 


J \hijit)\e'dt  < 


oo 

0 

oo 
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for  all  finite  n.  Hence  J exists  for  Vo;  and  Vn. 

0 

Let  us  now  place  the  constraint  |t;|  <  a.  Define 


Since 


and 


H(u;  -  iv) 


\hij{t)\ 


n 


E 


fc! 


< 

< 


n 


iftiiWiE 

fc=0 


A;! 


\hij{t)\  for  Vn 


J  l^ij  Wl  <  oo  if  |v|  <  a 
0 

Lebesque’s  dominated  convergence  theorem  gives: 


H(lj  —  iv) 


^  1  d^Hju) 

^  k\  dcj* 
k—O 


(v/if 


Let  s  —  Lx)  ~iv  and  notice  that  when  H{s)  exists  at  a  point  s  and  on  an  open 
neighbourhood  of  5  it  is  analytic  on  that  neighbourhood.  Since  H{s)  is  well 
defined  on  Sa  it  is  also  anal5d;ic  there.  Moreover,  we  already  know  that  H{s) 
exists  everywhere  on  TL^a  and  must  therefore  be  analytic  there.  Thus  we  may 
extend  H{s)  from  Sa  to  II-q  =  5^  U  Hq  by  analytic  continuation  (see  [9],  pp. 
96-97).  We  conclude  that  H{$)  is  an  analytic  extension  of  to  !!_«.  ■ 

In  a  similar  fashion  we  can  show  the  following  more  general  result: 


Proposition  12  Suppose  that  H{-)  6  is  of  type  —a  then  H{o})  is 

infinitely  differentiable  w.r.t.  u)  and  H{-)  has  an  analytic  extension  to  Sc  given 
by 


H{u) 


OO 


-  iv)  =  ^ 

n^O 


1  d^H{u)) 
n!  dcj” 


{v/if 


Proof.  The  proof  goes  along  the  same  lines  as  in  the  proof  of  proceeding 
proposition,  only  now  the  analysis  is  applied  to  a  double  sided  integral  since  we 
are  no  longer  assuming  causality  of  the  inverse  Fourier  transform.  ■ 

The  following  result  is  rather  obvious  and  is  in  fact  a  by-product  of  the 
“proof’  of  Proposition  12. 

Lemma  13  G  is  of  type  -a  then  k{')  €  for^iu)  s.t. 

0  >  u/  >  -a. 


Prom  the  lemma  we  can  make  the  following  statements: 


Corollary  14  The  class  of  functions  in  which  are  causally  generated 

of  type  -a  is  a  subset  of^R^<^n• 

Corollary  15  The  class  of  functions  in  which  are  of  type  —a  is  a 

subset 

An  interesting  fact  about  the  last  two  propositions  is  that  the  extension  of 
//(•)  to  Sa  has  a  form  like  a  Taylor  series.  Indeed  it  can  be  interpreted  as  a 
Taylor  series  and  we  will  now  formally  demonstrate  it.  Suppose  that  F(*)  is 
a  function  of  a  complex  variable  which  is  analytic  on  an  open  subset  of  the 
complex  plane  containing  the  real  axis  such  that  F{s)]g^^  =  Then  the 

Taylor  series  of  F(s)  about  the  point  sq  =  uj  exists  and  is  given  by; 


F{s) 


1  d^F{s) 


n=0 


n!  ds^ 


{s^ior 


g  1 

^  n!  du)^ 


E 

n=0 


1  d’^Hjoj) 


n!  du' 


when  |s  -  tt;|  <  R{uj)  (F(a;)  >  0  is  the  radius  of  convergence  of  the  Taylor  series 
of  F{$)  about  oj).  After  inserting  s  —  lo  —  iv  with  \v\  <  R{u)  we  obtain  the 
series: 


OO 

F(w  -  it))  =  ^ 

n=0 


1  d”H{u) 
n\  dw” 


{v/iT 


The  last  proposition  then  implies  that  when  H{-)  is  of  type  —a  the  Taylor 
expansion  of  F{s)  along  the  real  axis  can  be  guaranteed  to  have  a  uniform 
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radius  of  convergence  which  is  at  least  equal  to  a,  i.e.  we  may  set  R{uj)  =  a  for 
Vo;. 

Appealing  to  the  proof  of  the  above  results  we  can  make  the  following  infer¬ 
ence  on  the  relation  between  the  Fourier  and  Laplace  transform  and  the  analytic 
extension  of  functions  defined  on  the  imaginary  axis. 

Corollary  16  Let  h(-)  6  be  causally  generated  of  type  —a  (of  type 

—a)  and  let  G{iu>)  —  h{uj)  for^u  e  M.  Then  G(-)  is  a  function  defined  on  the 
imaginary  axis  and  has  an  anahjtic  extension  to  -iU-a  particular, 

on  —iSa  the  extension  is  given  by: 


G(v  iuj) 


oo 


E 


1  d^G{iLj) 
n! 


iv/if 


and  if  s  =  V  +  iu  then  G{s)  for  s  6  —iU-a  {^iSa)  coincides  with  the  the  one 
(double)  sided  Laplace  transform  ofh{-). 


We  conclude  this  chapter  with  a  final  remark. 

Remark  17  By  Lemma  13,  if  k{-)  e  L^^^{R)  is  of  type  -a  then  we  can 
find  an  cj  satisfying  0  >  lj  >  —a  such  that  A:(*)  6  C  L‘^^”‘{R). 

Thus  a  complex  matrix  valued  function  of  type  —a  can  be  viewed  as  the  Fourier 
transform  of  a  stable  (not  necessarily  causal)  impulse  response,  stable  being  in 
the  sense  that  the  impulse  response  decays  at  an  “exponential”  rate  as  |t|  — > 
oo.  In  connection  with  PSD  (power  spectral  density)  functions,  the  “type  —a” 
property  is  desirable  since  we  would  expect  a  “physical”  PSD  function  to  be 
associated  with  some  second  order  process  having  an  autocorrelation  function 
decaying  on  both  the  left  and  the  right  side  of  the  origin.  Thus  it  is  natural  to 
consider  the  class  of  PSD  functions  which  is  a  subset  of  complex  square  matrix 
valued  functions  of  type  -a. 
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Chapter  3 

Spectral  Factorization 

3.1  The  Paley- Wiener  Theorem 

An  important  result  on  the  factorization  of  positive  semidefinite  matrix  func¬ 
tions  is  the  Paley-Wiener  theorem  [10]  [12]  [7]  (R.  Paley  and  N.  Wiener  actually 
formulated  the  scalar  version  of  the  theorem,  the  general  multidimensional  re¬ 
sult  we  state  here  is  mainly  due  to  Wiener  and  other  co-workers  but  we  shall 
also  refer  to  the  general  version  as  the  Paley-Wiener  theorem).  We  start  with 
the  following: 

Definition  18  B)  =  {s  6  C  :  |s|  <  1} 

Definition  19  Co  =  {s  G  C  :  3f?(s)  >  0} 

Definition  20  The  Hardy  space  ^K2^”(P)  consists  of  all  n  x  n  matrix-valued 
analytic  functions  /(•)  defined  on  P  satisfying 

IT 

j  tr  (/(re’^)*/(re<®))  ddKoo'ire  [0, 1) 


and 

IT 

lim  f  tr  (fire^Yfire*^))  dO  <  oo 
rUj 

—  TT 


is  a  Hilbert  space  with  the  inner  product: 


<  /(•).<?(•)  >=  /  tr  (/(e‘‘')*p(e‘«))  d9f,g€ 
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Definition  21  The  Hardy  space  IKJ  ^"^(Cq)  consists  of  allnx  n  matrix-valued 
analytic  functions  /(•)  defined  on  Co  satisfying 

oo 

J  tr  {f  {a -\-iu)*f  {a -\-i(jj))du;  <  oo'^a  >  0 

—  oc 


and 


tr  (/(cr  +  iuj)*f{a  +  io;))  du)  <  oo 


J{^^”(Co)  is  a  Hilbert  space  with  the  inner  product: 


oo 

<  >=  J  tr(/(iw)*s(iw))dw  /,3  e 

—  OO 


Theorem  22  (Paley-Wiener)  Let  nhe  a  positive  integer.  A  positive  semidef- 
inite  Hermitian  matrix  valued  function  P(*)  e  Li  7r,7r))  has  a  factorization 
of  the  form 

p{e)  =  H{e)  {H{o)y  -  tt  <  6^  <  tt 

with  //■(•)  e  if  and  only  if  the  Paley-Wiener  condition  lndetP(*)  € 

Li([-7r,7r)),  i.e. 

■K 

J \]ndetP{0)\d9<oo, 

—  TT 

holds. 


We  may  also  restate  the  theorem  in  the  following  form: 

Theorem  23  (Paley-Wiener)  Let  n  he  a  positive  integer.  A  positive  semidef- 
inite  Hermitian  matrix  valued  function  P(-)  €  L‘^^^{M.)  has  a  factorization  of 
the  form 

P{uj)  —  H{u))  {H{lj))*  —  oo  <  uj  <  oo 

with  P(')  €  IK2^’^(Co)  if  and  only  if  the  Paley-Wiener  condition  ^  € 

Li{R),  i.e. 

oo 

f  llndet  P(cj)|  , 

J  i+j 

— oo 

holds. 

Remark  24  H{-)  is  called  a  spectral  factor  o/P(*).  Spectral  factors  are  only 
unique  up  to  multiplication  on  the  right  by  a  constant  unitary  matrix.  Thus,  if 
H{-)  is  a  spectral  factor,  so  is  H{-)U  for  some  constant  unitary  mairix  U. 
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Remark  25  Note  that  L2(0, oo)  {l2{^+))  is  isomorphic  to  H2{Co)  (H2{^)) 
(see  [5]j  Lemma  A. 6.21),  i.e.  there  is  a  bijective  mapping  from  1/2(0, oo) 
(/2(^+))  to  H2(Co)  (i?2(®))).  This  means  for  any  x  €  L2(0,  oo)  (Z2(Z+))  there 
corresponds  a  unique  y  €  ^^2(^0)  (/f2(®)))  and  vice-versa. 

Thus  given  an  arbitrary  integrable  multidimensional  PSD  function  P(-),  the 
Paley-Wiener  theorem  tells  us  precisely  whether  or  not  there  exists  a  causal  LTI 
system  with  an  impulse  response  in  1/2(0, 00)  (/2(Z+))  that  generates  P(-)-  In 
Wiener’s  own  words  [11]  there  cannot  exist  a  causal  LTI  system  whose  frequency 
response  H{-)  is  zero  for  any  subset  of  R  ([-tTjTt))  of  positive  measure,  i.e.  a 
causal  LTI  system  can  never  provide  infinite  attenuation  (attenuation  is  defined 
as  |in|detP'(-)||)  over  any  disjoint  union  of  finite  intervals. 


3.2  Necessity  of  Spectral  Factorization 

In  deriving  a  dynamical  model  for  a  scalar  or  multidimensional  stochastic  pro- 
cess  Y  whose  only  known  characteristic  is  its  PSD  function  Pf(-)j  spectral  fac¬ 
torization  is  necessary  because  a  spectral  factor  Py  (*)  is  the  frequency  response 
of  an  LTL  system  which  generates  the  process  Y  when  driven  by  a  white  noise 
process.  However,  given  an  arbitrary  non-scalar  and  irrational  PSD  function 
Py(-)  satisfying  the  Paley-Wiener  condition,  there  is  not  yet  available  a  general 
method  for  analytically  deriving  a  spectral  factor  and  is  in  fact,  quite  a  difficult 
affair  (e.g.  see  [7]).  However,  if  Py(')  is  rational  then  it  is  possible  to  compute 
a  spectral  factor  after  a  finite  number  of  iterations  and  this  spectral  factor  will 
also  be  rational  [13].  Thus  for  practical  purposes  it  is  easier  to  first  construct 
a  good  rational  approximant  A'(-)  of  Py(*)  and  use  the  LTI  system  obtained 
from  the  rational  spectral  factor  of  Py(*)  as  an  approximate  dynamical  model 
for  generating  the  stochastic  process  Y. 

In  the  next  chapter  we  will  show  one  method  of  realizing  rational  approxi- 
mants  for  the  scalar  Kolmogorov  and  von  Karman  spectra  using  so-called  Pade 
approximants.  Based  on  these  rational  approximations  we  shall  construct  low 
order  LTI  systems  as  approximate  generators  for  both  spectra. 

Remark  26  We  will  often  refer  to  an  LTI  system  that  produces  a  second  order 
WSS  stochastic  process  Y  with  PSD  Py(*)  when  driven  by  white  noise  as  the 
generator  ofY  or  the  genera, tor  o/Py(  ). 
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Chapter  4 

Rational  Approximations 


4.1  Overview 

In  this  chapter,  rational  approximations  to  two  scalar  spectral  densities  that  are 
frequently  encountered  when  dealing  with  turbulence,  i.e.  the  Kolmogorov  and 
vor  Karman  spectrum,  are  presented. 

The  Kolmogorov  spectrum  is  given  by: 


(i+w2)i 


where  cr  is  a  positive  constant.  A  graph  of  the  Kolmogorov  spectrum  is  given 
in  Fig.  4.1  and  Fig.  4.2. 


Figure  4.1:  The  Kolmogorov  spectrum 


The  slightly  more  complicated  von  Karman  spectrum  is  given  by: 
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Figure  4.2:  The  Kolmogorov  spectrum  (log-log  scale) 


p  /  ,  2fc(l  +  f fe^(1.339)V) 

(1  +  F(1. 339)2^2)  ¥ 

where  A:  is  a  positive  scale  parameter.  A  graph  of  the  von  Karman  spectrum  is 
shown  in  Fig.  4.3  and  Fig.  4.4. 


Figure  4.3:  The  von  Karman  spectrum 


The  most  important  facts  to  note  about  both  spectra  is  that  they  are: 

(51)  Irrational. 

(52)  Symmetric  about  the  vertical  axis. 
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Figure  4.4:  The  von  Karman  spectrum  (log-log  scale) 


(iSS)  Decaying  to  zero  as  a;  — >  dboo. 

(54)  Infinitely  differentiable  with  respect  to  u). 

It  is  also  easy  to  check  that  the  two  spectra  satisfy  the  Paley-Wiener  condition 
and  thus  each  has  a  spectral  factor  in  Furthermore,  both  spectra  have 

a  meromorphic  extension  to  the  complex  plane.  In  the  remainder  of  this  report 
we  will  interpret  Pk{')  and  Pvk{')  dually  either  as  functions  defined  on  the  real 
axis  or  as  functions  defined  on  the  complex  plane.  In  particular,  P/c(t^)  and 
Pvk{^)  will  be  viewed  as  the  restriction  of  Pk{z)  and  Pvk{z)j  respectively,  to 
the  real  line. 


4.2  Fade  Approximation 

Given  a  scalar  complex  function  f(z)  analytic  around  z  =  zq  and  its  Taylor  series 
expansion  about  zq 

A:=0 


we  may  construct  a  rational  function  with  a  polynomial  numerator  P{z) 
of  degree  L  and  a  polynomial  denominator  Q{z)  of  degree  M  such  that: 

f{z)Q{z)  ^  P{z)  =  0(;2^+^+^) 


The  quotient  having  the  property  above  is  called  a  Pade  approximant 
of  f{z)  about  Zq.  The  coefficients  of  P{z)  and  Q{z)  can  be  computed  by  solving 
a  set  of  linear  equations.  We  will  not  give  a  treatment  of  the  theory  of  Pade 


17 


approximation  of  analytic  functions,  suffice  that  in  this  chapter  we  will  see 
some  features  of  the  Fade  technique.  The  reader  should  refer  to  an  excellent 
monograph  by  Baker  and  Graves-Morris  [2]  for  a  thorough  discussion  on  the 
theoretical  aspects  of  Fade  approximation. 

Notation  27  Pade[L/M]  is  used  to  denote  a  Fade  approximation  with  the  nu¬ 
merator  polynomial  having  degree  L  and  the  denominator  polynomial  having 
degree  M. 

Remark  28  It  should  be  observed  that  all  scalar  real  valued  positive  semidefinite 
proper  (the  degree  of  the  numerator  is  equal  to  the  degree  of  the  denominator) 
or  strictly  proper  (the  degree  of  the  numerator  is  less  than  the  degree  of  the 
denominator)  rational  functions  satisfy  the  Paley-Wiener  condition.  Therefore, 
any  rational  Fade  approximants  having  these  properties  possess  spectral  factors 
in  H2{^)- 


4.3  Rational  Approximation  of  the  Kolmogorov 
Spectrum 

In  current  practice,  the  Kolmogorov  spectrum  is  approximated  using  the  so- 
called  Dryden  approximation.  The  Dryden  appoximation  to  the  Kolmogorov 
spectrum  is  given  by: 

where  the  positive  constant  C  is  chosen  such  that 

A  visualization  of  the  fit  of  the  Dryden  approximation  to  the  Kolmogorov 
spectrum  when  a  =  1  is  shown  in  Fig.  4.5  and  Fig.  4.6.  In  this  case  the  value 
of  C  that  was  computed  (using  a  numerical  integration  routine  on  Matlab  ®)  is 
C=  1.1571. 


/oo 

Pfc  {u))d.u) 

-oo 
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Poww  spectral  Density 


Frequency  (rad/s) 


Figure  4.5:  The  Kolmogorov  spectrum  and  its  Dry  den  approximation 


Figure  4.6:  The  Kolmogorov  spectrum  and  its  Dryden  approximation  (log-log 


We  may,  however,  also  construct  various  Fade  approximations  to  the  Kol¬ 
mogorov  spectra  based  on  the  Taylor  expansion  of  Pk{’)  about  z  —  Q.  Table  4.1 
shows  the  first  25  coefficients  of  the  Taylor  series  expansion. 


n 

Cn  Taylor  series  coefficient) 

Cn  =  0  for  n  positive  odd 

0 

1 

2 

5 

fi 

4 

6 

8 

10 

T/472y 

12 

6718464 

14 

40S107?^4 

16 

I!iOlYoli915 

18 

^{3693487495 

,104485R52128 

20 

75I583I5244I 

12.'j382R62f|R36 

22 

4441173173515 

7522959753216 

24 

315323295319565 

_ .54165.3102231552 _ 

Table  4.1:  Coefficients  of  the  Taylor  series  expansion  of  Pk[')  about  z  =  0 
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The  Taylor  series  coeffients  are  used  to  construct  various  Fade  approxima¬ 
tions  to  the  Kolmogorov  spectrum.  These  approximations  were  computed  using 
Maple®  version  8.0  and  are  shown  in  Table  4.2. 


M 

Fade[M/M+l]  approximant 

1 

. 

2 

3 

^  ^  _  _  _  _  _ 

4 

1  4.  _7_  3j2  _i_  •  ^4 

5 

A-|-15«  1-720* 

1  1  17  ^..27  187  ..47  187  Jr 

~24Q"^  “2S92^ 

10 

1  1  _2  1  ^4  1  tji _,o  1  t>i//o  „8  1  1235  _10 

7??  T  004  -5  1-1^2'^  Tl8fifi24*'  '  fi71R4fi4^  ,  ^ . 

11 

1  1  ioo  ^2  1  Wo  ^4  1  14725  ^6  1  lyl4J5  i  iJo2o5  ^lo 

■^"’"  66^  ■*■396^  ■'■21384^  ■*■2052864'“  ‘  12317184^  ^ 

1  1  35  .^2  1  1015  ^4  1  23345  ...fi  j  396865  1  11339  ...in  1  56695  ^12 

■*■  2fi4  ■'■10692^  ■*~fiR42RR'“  *  186624"' _ *  40.310784  ^ _ 

Table  4.2:  Various  Fade  approximants  of  the  Kolmogorov  spectrum  (cr  =  1) 
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The  result  of  using  a  Pade[l/2]  approximation  is  shown  in  Fig.  4.7  and 
Fig.  4.8.  It  can  be  seen  visually  that  at  least  in  the  region  of  the  dominant 
frequency  components  the  Pade[l/2]  approximation  alone,  which  is  the  simplest 
approximation  in  the  table,  already  outperforms  the  Dryden  approximation. 
Fig.  4.9  and  Fig.  4.10  show  the  result  of  using  Fade [11/12],  this  high  order 
approximation  fits  the  original  spectrum  quite  well  over  a  wide  frequency  range. 


Figure  4.7:  The  Kolmogorov  spectrum  and  its  Pade[l/2]  approximation 
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Figure  4.8:  The  Kolmogorov  spectrum  and  its  Pade[l/2]  approximation  (log-log 
scale) 


Prom  the  table,  it  is  seen  that  for  odd  M,  the  [M/M  +  1]  approximants 
approach  zero  as  cj  — >  ±oo.  Recall  that  this  is  one  of  the  properties  of  the 
Kolmogorov  spectrum.  However,  for  even  M,  this  property  does  not  hold  since 
the  order  of  the  numerator  and  denominator  are  the  same  (i.e.  the  coefficient 
of  the  odd  powered  leading  term  of  the  denominator  is  zero)  hence  at  ±oo  the 
approximants  do  not  approach  zero  (although  the  values  achieved  at  oo  become 
smaller  as  M  goes  to  oo  through  a  sequence  of  even  integers).  Further  notice 
how  all  the  approximants  surprisingly  have  the  properties  S2  and  S3  of  the 
original  spectrum.  As  a  consequence  we  find  that: 

•  The  numerator  and  denominator  of  the  Fade  approximants  contain  only 
even  powers  of  2. 

•  For  even  M,  the  order  of  the  denominator  is  the  same  as  the  order  of  the 
numerator  because  the  highest  order  term  in  the  numerator,  which  is  odd, 
has  a  zero  coefficient. 

We  want  to  use  an  approximant  that  behaves  as  closely  as  possible  to  the 
original  spectrum  (i.e.  at  least  reproducing  the  properties  S2,  S3  and  S4)  so  it 
is  best  to  choose  [M/M  +  1]  approximants  with  odd  M. 

In  Table.  4.6  the  locations  of  the  poles  and  zeros  of  various  Fade  approxi¬ 
mants  are  given.  These  values  can  give  us  some  insight  into  the  location  and 
types  of  poles  and  zeros  of  the  function  that  is  being  approximated  over  the 
complex  plane  (see  Section  2.2  of  [2]).  One  can  notice  a  persistent  crowding 
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Frequency  (rad/s) 


Figure  4.9:  The  Kolmogorov  spectrum  and  its  Pade[ll/12]  approximation 


Frequency  (rad/s) 

Figure  4.10:  The  Kolmogorov  spectrum  and  its  Pade[ll/12]  approximation  (log- 


of  poles  and  zeros  around  the  points  z=-l  and  z=l  which  suggests  that  there 
may  be  present  an  essential  singularity  in  the  vicinity  of  each  point.  Further¬ 
more,  some  pole-zero  pairs  are  very  close  indicating  that  it  may  be  permissible 
to  cancel  out  each  of  these  pole-zero  pairs.  However,  at  this  stage  we  will  not 
be  scrutinizing  this  aspect  of  the  approximation. 
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[M/M+l] 

Zeros 

Poles 

[29/30] 

11.3012i 

14.0127i 

-11.3012i 

-14.0127i 

[M/M+l] 

Zeros 

Poles 

5.2228i 

5.7351i 

[1/2] 

1.0954i 

-5.2228i 

-5.7351i 

L0954i 

3.4150i 

3.6217i 

[3/4] 

1.6036i 

1.9375i 

-3.4150i 

-3.6217i 

-1.6036i 

-  L9375i 

2.5569i 

2.6668i 

L0228i 

-2.5569i 

-2.6668i 

~  1.0228i 

2.0613i 

2.1286i 

[5/6] 

2.3214i 

2.8466i 

-2.0613i 

-2.1286i 

-2.3214i 

-  2.8466i 

1.7426i 

1.7874i 

1.2117i 

1.2948i 

-1.7426i 

-1.7874i 

-1.2117i 

-  L2948i 

1.5236i 

1.5550i 

l.OlOli 

-1.5236i 

-L5550i 

-  LOlOli 

1.3668i 

1.3897i 

[11/12] 

4.5468i 

5.6241i 

"1.3668i 

-1.3897i 

4.5468i 

-5.6241i 

1.2517i 

1.2686i 

2.1563i 

2.3544i 

-1.2517i 

-1.2686i 

-2.1563i 

-2.3544i 

1.1663i 

1.1788i 

1.4766i 

1.5517i 

-L1663i 

-1.1788i 

-1.4766i 

-L5517i 

1.1031i 

1.1123i 

1.1835i 

1.2184i 

-1.1031i 

-1.1123i 

-1.1835i 

-1.2184i 

1.0573i 

1.0639i 

1.0469i 

1.0625i 

-  1.0573i 

-1.0639i 

-  l,0469i 

-L0625i 

1.0260i 

1.0303i 

1.0025i 

-l,0260i 

-1.0303i 

-1.0025i 

1.0072i 

1.0095i 

-1.0072i 

-  1.0096i 

1.0004i 

-1.0004i 

Table  4.3:  Location  of  the  poles  and  zeros  of  various  Fade  approximants  of  the 
Kolmogorov  spectrum  (cr  =  1) 
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4.4  Rational  Approximation  of  the  von  Karman 
Spectrum 

This  section  is  basically  a  repeat  for  the  von  Karman  spectrum  of  what  was  done 
in  the  previous  section  for  the  Kolmogorov  spectrum.  In  particular  we  compute 
some  Fade  approximants  of  the  von  Karman  spectrum.  Table  4.4  gives  the 
values  of  the  few  coefficients  of  the  Taylor  series  expansion  of  Pvk{z)  about 
z  —  0  while  in  Table  4.5  the  [1/2],  [3/4],  [5/6],  [11/12]  approximants  of  Pvk{z) 
are  given. 


n 

Cn  Taylor  series  coefficient) 

Cn  =  0  for  n  positive  odd 

0 

2 

2 

2.988201668 

4 

-14.73342618 

6 

41.58053484 

8 

-100.0220740 

10 

222.8836556 

12 

-474.8485274 

14 

982.2035130 

16 

-1989.606379 

18 

3967.967356 

20 

-7818.702442 

22 

15259.17150 

24 

-29547.89192 

Table  4.4:  Coefficients  of  the  Taylor  series  expansion  of  Pvk{’)  about  z  =  0 


Fade[M/M-{-l]  approximant 

'  1 

2 

1-1.49410083422 

B 

2+12.849267162=' 

1+4.93053274722 

3 

2+^613206908? 

1+3.31250262022+2.41750016324 

4 

2f9.7481255822='+3.86680304642^ 

“145737996195722+2. 7501 1062824 

5 

B 

2+14.5180024l2='+27.2224820624+17.552364292‘’43.2720245542‘^40.039091838032^‘^ 

146.76490037222+12.3646116724+11.980305162®+4.97999158228^.63764209272io 

1+6. 19576684022+14.6768516824+16.465622852^.71354178528+1 .83444615021040.08586731442212  j 

Table  4.5:  Various  Fade  approximants  of  the  von  Karman  spectrum  for  A:  =  1 

The  same  remarks  in  the  previous  section  for  the  Fade  approximants  of  the 
Kolmogorov  spectrum  goes  also  for  the  Fade  approximants  of  the  von  Karman 
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spectrum,  except  that  in  the  present  case  the  Pade[l/2]  approximant  performs 
very  poorly  since  it  has  a  pole  on  the  real  line  and  possesess  none  of  the  prop¬ 
erties  S2,  S3,  and  S4.  Thus  the  simplest  Fade  approximant  that  is  useful  for 
the  von  Karman  spectrum  is  the  Pade[3/4]  approximant.  The  corresponding 
Dryden  type  approximation  is  given  by: 

^  ^  2A;(H- |A:2(1.339)V) 

Pd-vkH  -  (1  ifc2 (1.339)2^^2)2 


where  the  positive  constant  C  is  chosen  such  that 


C 


2ifc(l  +  |P(1.339)V) 
(1+F(1.339)2w2)2  ^ 


L 


For  A:  =  1,  C  =  1.2086.  Fig.  4.11  and  Fig.  4.12  show  the  fit  of  the  Dryden  type 
approximation  while  Fig.  4.13  and  Fig.  4.14  show  the  fit  of  the  Pade[3/ 4] .  Again, 
visually  it  is  clear  that  the  Fade  [3/4]  is  superior  to  the  Dryden  approximation 
in  the  main  frequency  range,  although  it  is  achieved  at  a  higher  order.  The 
result  of  using  Pade[ll/12]  is  shown  in  Fig.  4.15  and  Fig.  4.16.  Once  again  the 
latter  higher  order  approximation  fits  the  original  spectrum  very  nicely  over  a 
wide  frequency  range. 
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Frequency  (rad/s) 

Figure  4.11:  The  von  Karman  spectrum  and  its  Dryden  approximation 
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Figure  4.12:  The  von  Karman  spectrum  and  its  Dryden  approximation  (log-log 
scale) 


In  Table.  4.6  the  locations  of  the  poles  and  zeros  of  various  Fade  approxi- 
mants  are  given.  There  seems  to  be  a  crowding  of  poles  and  zeros  around  the 
pair  of  points  {  z==-0.6,  z=-0.7  }  and  {  z=0.6,  z=0.7  },  suggesting  that  there  may 
be  present  an  essential  singularity  in  the  vicinity  of  each  pair.  Again,  we  can  see 
that  some  pole-zero  pairs  are  very  close  indicating  that  it  may  be  permissible 
to  cancel  out  these  pairs. 
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Figure  4.13:  The  von  Karman  spectrum  and  its  Fade [3/4]  approximation 


Figure  4.14:  The  von  Karman  spectrum  and  its  Fade [3/4]  approximation  (log- 
log  scale) 
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Power  Spectral  Density 


Figure  4.15:  The  von  Karman  spectrum  and  its  Pade[ll/12]  approximation 


Figure  4.16:  The  von  Karman  spectrum  and  its  Pade[ll/12]  approximation 
(log-log  scale) 


[M/M+l] 

Zeros 

Poles 

[29/30] 

3.5616i 

4.4072i 

-3.5616i 

-4.4072i 

[M/M+l] 

Zeros 

Poles 

1.6932i 

1.8465i 

[1/2] 

0.4504i 

-1.6932i 

-1.8465i 

-0.4504i 

1.1739i 

1.2307i 

[3/4] 

0.4561i 

0.9598i 

-1.1739i 

-1.2307i 

-0.4561i 

-0.9598i 

0.6425  +  0.5681i 

-0.6425  +  0.5681i 

0.6701i 

0.6425  -  0.5681i 

-0.6425  -  0.5681i 

-0.6701i 

0.7850 

-0.7850 

[5/6] 

L4260i 

l,7457i 

0.6852  4-  0.1813i 

-0.6852  +  0.1813i 

-1.4260i 

-1.7457i 

0.6852  -  0.1813i 

-0.6852  -  0.1813i 

0.4573i 

0.8081i 

0.5351  +  0.3938i 

-0.5351  -h  0.3938i 

-0.4573i 

-0.8081i 

0.5351  -  0.3938i 

-0.5351  -  0.3938i 

0.7218i 

-0.6425  +  0.5681i 

0.6425  -h  0.5681i 

-0.7218i 

-0.6425  -  0.5681i 

0.6425  -  0.5681i 

[11/12] 

3.1922i 

3.9502i 

-0.7850 

0.7850 

-3.1922i 

-3.9502i 

-0.6852  -h  0.1813i 

0.6852  -h  0.1813i 

1.5097i 

1.6490i 

-0.6852  -  0.1813i 

0.6852  -  0.1813i 

-1.5097i 

-1.6490i 

-0.5351  +  0.3938i 

0.5351  +  0.3938i 

1.0339i 

1.0861i 

-0.5351  -  0.3938i 

0.5351  -  0.3938i 

-1.0339i 

-1.0861i 

0.9509i 

0.9780i 

0.8344i 

0.8575i 

-0.9509i 

-0.9780i 

-0.8344i 

-0.8575i 

0.8371i 

0,8515i 

0.4573i 

0.7582i 

-0.8371i 

-0.8515i 

-0.4573i 

-0.7582i 

0.7765i 

0.7840i 

0.7419i 

-0.7765i 

-0.7840i 

-0.7419i 

0.4573i 

0.7508i 

-0.4573i 

-0.7508i 

0.7451i 

-0.7451i 

Table  4.6:  Location  of  the  poles  and  zeros  of  various  Fade  approximants  of  the 
von  Karman  spectrum  {k  =  1) 
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Chapter  5 

Approximate  Linear 
State-Space  Models 

5.1  Overview 

In  this  chapter  we  will  use  the  approximation  constructed  in  the  previous  chap¬ 
ter  to  obtain  approximate  linear  models  for  the  actual  (infinite  dimensional) 
linear  (time-invariant)  system  which  generated  the  stochastic  process  having 
the  Kolmogorov  or  the  von  Karman  spectrum  as  its  PSD. 


5.2  Approximate  Generator  for  the  Kolmogorov 
Power  Spectrum 

As  we  had  seen  in  the  last  chapter,  the  Pade[l/2]  approximant  is  a  better  fit  to 
the  Kolmogorov  power  spectrum  along  the  frequency  domain  than  the  simple 
Dryden  approximation.  The  Pade[l/2]  approximant  is  given  by: 

P.de|./2|  . 

However,  in  systems  theory  a  frequency  response  is  considered  as  a  function 
defined  on  the  imaginary  axis.  Thus  we  will  work  with  the  function 

Pk,ii/2iM  = 

_  1 
“  1  - 

instead.  However  the  above  frequency  domain  characteristic  are  still  that  of 
a  continuous  time  system.  For  practical  purposes,  one  usually  uses  a  digital 
computer/controller,  thus  we  need  to  discretize  the  rational  approximant  given 
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a  sampling  time  T.  Note  that  choosing  an  optimal  value  for  T  must  be  done 
carefully  by  taking  into  consideration  the  profile  of  Pa'(')  and  the  sampling 
theory  for  stochastic  signals  (e.g.  see  [3],  Chapter  6).  Assume  that  we  have 
chosen  an  optimal  T,  then  we  discretize  as  follows.  First,  determine  the  discrete 
autocorrelation  function  [-](*)  s^ssociated  with  Pk, [i/2]{')  by  the  relation 

PK,[l/2]{n)  =  J  PK,[i/2]{v)e^^'^'^dv 

=  ./Ze-v/fNT 

V 10 

Prom  Rk, [i/2]{')  we  can  construct  the  discrete  PSD  Dk,[i/2](-)  on  the  unit 
circle  defined  by: 


oo 

DK,[i/2]{e"^)  =  ^K,(i/2)(n)e*”®  for  -Tr<e<n 

n__oo 


■m 

=  /l 
V  10 


yfnT  -»ti0 


+  1  + 


+ 1  + 

1 

e««  -  / 


/"F  (eVT^  - 


We  may  then  easily  factorize  DK,(i/2](e*')  as: 


£>K,[i/2l(e’®) 


1 

1  - 


Finally  let  us  now  define 


1 

1  -  e“^^e~vT'^ 


then  =  D/c,(i/2](e^^)  and  i/K,{i/2](fi*^)  is  the  frequency  response 

of  a  stable  causal  discrete  linear  system.  It  is  clear  that  if  a  (discrete- time)  white 
noise  process  is  passed  through  a  filter  with  frequency  response  Hk,[i/2]{^''^) 
then  the  output  of  the  filter  will  be  a  second  order  (stationary  process)  having 
the  power  spectrum  Dk,[i/2]{^*^)-  This  is  the  approximate  filter  that  we  are 
looking  for. 
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A  minimal  degree  state  space  representation  for  a  discrete  LTI  system  having 
the  frequency  response  ///<:, {i/2](e^’)  is  easily  found  to  be: 

x(k-\-l)  =  e^^'^x{k) -{-u{k) 

y{k)  =  ]J -  e-^'/^'^)x{k) 

where  k>0.  We  assume  that  the  input  signal  {w(0),  w(l), u{n)}  is  a  standard 
white  noise  process  with  unit  variance,  x(0)  is  uncorrelated  with  {u{k)}kez+  and 
we  let  the  system  run  long  enough  so  that  it  is  virtually  in  statistical  steady 
state. 


5.3  Approximate  Generator  for  the  von  Karman 
Power  Spectrum 

In  this  section  we  will  repeat  the  procedure  of  the  last  section  to  derive  an 
approximate  generator  for  a  stochastic  process  having  the  von  Karman  spectrum 
as  it  PSD.  The  main  difference  here  is  that  the  simplest  approximation  we  can 
take  is  the  Fade [3/4]  approximation  (see  the  previous  chapter).  Thus  in  the  end 
we  will  have  a  higher  order  model  with  two  states  rather  than  the  single  state 
model  that  we  derived  for  the  Kolmogorov  spectrum.  Since  the  procedure  is 
identical  we  will  reuse  the  notation  of  the  last  section  and  will  omit  most  details 
of  the  derivation. 

First  of  all  we  have  that: 


■Rv/C,[3/4]  (^) 


1 


from  which  we  find 
^uK,[3/4](e*^)  — 


^  0.841553271 

7.564513400^^  _  q  393053575^10) (i  _  0.398053675e-^^) 

0.738212839 

-2.997334813^^  _  o.5ii651405e*'^)(l  -  0.511651405e-^^) 


To  avoid  clutter  and  since  our  purpose  here  is  for  demonstration  let  us  take 
T  =  1.  For  this  particular  value  of  T  we  have: 


^  e-^^(-2.37638081521232e*2<^  +  4.57350384251358e^^  -  2.37638081521232) 

DyK,\3/4]{e^  )  -  „  ae-*^)(l  -  /?e»^)(l  -  /3e-^^) 

_ _ e-^^(e^^-A-^)(e*^- A) _ 

(1  —  —  Q:e“‘^){l  —  /?e*^)(l  —  pe~''^) 
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where 


0.398053675 

0.511651405 

1.720133060 


a  = 

^  = 
A  = 


Most  of  the  complicated  algebraic  manipulations  above  were  done  with 
Maple®  version  8.  Finally  we  may  factor  as* 


n  =  f 


We  now  define 


HvK,[3/4]{g^^)  ~ 


1  -  Ae-*^ 

(l-Qe-»^)(l-/?e-‘^) 


which  is  basically  the  frequency  response  of  a  stable  causal  system  generat¬ 
ing  the  discrete  power  spectrum  7)vK’,[3/4i(6**)-  A  minimal  degree  state  space 
representation  of  Jy'vX,[3/4](e^  )  is  given  by: 


x(k  -h  1) 

y{k) 


a  +  0 

a+/3 

x{k)  + 

r  1  -  ^  1 

_  a  +  P 

0 

1 

[  a  +  /3  0  ]  x{k)  +  u{k) 


u{k) 


5.4  Stochastic  Control  Using  Approximate  gen¬ 
erators 

When  one  is  given  the  task  of  designing  a  controller  for  atteniiating/cancelling 
a  stochastic  disturbance,  one  usually  needs  a  dynamical  model  for  the  “phys¬ 
ical  process”  which  is  generating  the  disturbance.  For  a  disturbance  which  is 
assumed  to  be  second  order  wide  sense  stationary  (WSS),  the  standard  model 
is  that  of  a  causal  LTI  system  driven  by  a  white-noise  process  [13]  [1].  Once  a 
dynamical  model  has  been  determined  then  one  can  proceed  to  design  a  con¬ 
troller  based  on  the  theory  of  stochastic  optimal  control  (for  finite  dimensional 
systems,  see  [1]).  However,  if  the  d)mamical  model  is  infinite  dimensional  then 
the  optimal  contoller  will  also  be  infinite-dimensional  in  general.  This  situation 
is  problematic  from  an  applications  point  of  view  since  a  infinite  dimensional 
controllers  does  not  lend  itself  to  instrumentation.  In  this  situation,  the  alter¬ 
native  is  to  approximate  infinite  dimensional  dynamical  model  with  one  which 
is  finite  dimensional  (i.e.  substitute  an  approximate  finite  dimensional  model 
for  the  actual  infinite  dimensional  model)  and  then  design  a  finite-dimensional 
optimal  controller  based  on  the  standard  theory  as  described  in  [ij.  However, 
in  the  problem  that  is  being  considered  in  this  report,  the  scenario  is  slightly 
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different.  The  characteristic  of  the  disturbance  that  is  known  is  its  PSD  func¬ 
tion.  This  does  not  immediately  provide  us  with  a  dynamical  model,  but  must 
be  obtained  through  spectral  factorization  (see  Chapter  3).  From  this  point  one 
may  proceed  in  two  ways: 

1.  Explicitly  determine  a  spectral  factor  and  then  construct  a  rational  ap¬ 
proximation  to  it. 

2.  Directly  construct  a  rational  approximation  for  the  PSD  and  then  utilize 
a  spectral  factor  of  the  approximant  as  a  finite  dimensional  approximation 
of  a  spectral  factor  of  the  true  PSD. 

In  this  report  we  have  opted  to  take  the  second  approach,  and  the  results  have 
been  shown  in  the  previous  two  sections.  However,  it  is  difficult  to  verify  just 
how  a  control  system  based  on  the  approximate  generators  will  perform  without 
real  experimental  data.  Actually  generating  a  stochastic  process  V  with  PSD 
function  which  is  that  of  the  Kolmogorov  or  von  Karman  spectra  on  a  digital 
computer  is  difficult,  if  not  impossible,  due  to  the  infinite-dimensionality  of  its 
true  generator. 

Remark  29  IVe  noticed  that  there  has  recently  been  a  similar  effort  towards 
constructing  rational  approxima.nts  of  the  von  Karman  spectrum  in  [6].  In  that 
paper  a  rather  complicated  “diffusive  representation”  approach  was  used.  It 
seems  that  our  approach  is  better  than  that  approach  in  terms  of  simplicity, 
the  insights  it  gives  into  the  behaviour  of  the  transfer  function  throughout  the 
complex  plane  and  the  possibility  of  constructing  good  low  order  approximants. 


38 


Chapter  6 

Conclusions 


In  this  report  we  have  constructed  Fade  approximants  for  the  Kolmogorov  and 
von  Karman  spectra.  These  approximants  are  able  to  give  a  good  fit  of  the 
spectra,  even  the  lower  order  ones.  In  particular,  the  Pade[l/2]  approximant 
for  the  Kolmogorov  spectrum  performs  better  than  the  typical  Dryden  approx¬ 
imation  that  is  used  in  practice  today.  In  this  report  we  have  used  [M/M-f  1] 
Fade  approximants  with  odd  M  for  the  purpose  of  preserving  some  important 
properties  of  the  original  spectra  in  their  Fade  approximants.  Based  on  the  Fade 
approximants,  approximate  finite-dimensional  LTI  generators  of  the  spectra  can 
be  obtained  in  lieu  of  the  actual  generators  of  the  Kolmogorov  and  von  Karman 
spectra  which  are  necessarily  infinite- dimensional.  The  finite-dimensional  LTI 
generators  can  in  turn  be  used  as  a  substitute  for  the  actual  infinite  dimen¬ 
sional  generators  for  the  control  of  stochastic  disturbances  having  either  the 
Kolmogorov  or  the  von  Karman  spectrum  as  its  FSD  function  (e.g.  wind  gust). 
In  order  to  assess  how  these  approximate  generators  will  affect  a  real  control 
system,  data  samples  coming  from  an  actual  stochastic  process  characterized  by 
the  Kolmogorov  or  von  Karman  spectrum  will  be  required. 


\ 
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